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Abstract 

We consider a heterogeneous queueing system consisting of one large pool of 0{r) identical servers, 
where r — >■ oo is the scaling parameter. The arriving customers belong to one of several classes which 
determines the service times in the distributional sense. The system is heavily loaded in the Halfin-Whitt 
sense, namely the nominal utilization is 1 — aj \fr where a > is the spare capacity parameter. Our goal 
is to obtain bounds on the steady state performance metrics such as the number of customers waiting in 
the queue Q^ipa). While there is a rich literature on deriving process level (transient) scaling limits for 
such systems, the results for steady state are primarily limited to the single class case. 

This paper is the first one to address the case of heterogeneity in the steady state regime. Moreover, 
our results hold for any service policy which does not admit server idling when there are customers 
waiting in the queue. We assume that the interarrival and service times have exponential distribution, 
and that customers of each class may abandon while waiting in the queue at a certain rate (which 
may be zero). We obtain upper bounds of the form O(y'r) on both Q^ipo) and the number of idle 
servers. The bounds are uniform w.r.t. parameter r and the service policy. In particular, we show 
that limsup,, Eexp(6r~2Q'"(oo)) < co. Therefore, the sequence r'T-Q^ipo) is tight and has a uni- 
form exponential tail bound. We further consider the system with strictly positive abandonment rates, 
and show that in this case every weak limit Q{oq) of r~2Q'"(cxD) has a sub-Gaussian tail. Namely 
E[exp(6l(g(oo))^)] < 00, for some 6* > 0. 



1 Introduction 



Recently we have witnessed an explosion of interest in large scale queueing systems operating in the so-called 
Halfin-Whitt heavy traffic regime. Such systems are attractive for modeling large scale service systems 
such as call/contact services or computer farms (used in cloud computing), as they achieve high utilization 
and low service delay at the same time [AAM07| . iBGM+OSj . jNGM03| . Most of the prior literature on 
the subject, including the paper by Halfin and Whitt |HW81| . which has initiated the subject, focused 
on the single class case where customers with identical in distribution service requirements are processed 
by a large pool of identical servers. This includes the earlier follow up papers such as |RP00j . which 
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focused on the case of exponential and phase-type distribution of model primitives, as well as more recent 
works |Ree09) . [RPOO) . |JMM04j . |MM05j . |GM08| . [KR] . [KROT] . jGGll) . 

The multiclass models have been analyzed as weh |DT10j . |ST10| . [XG| . |AMR04aj . |AMR04b| . specifically 
in the context of finding asymptotically optimal control policies, but primarily in the transient as opposed to 
the steady state regime. In the multiclass environment it is assumed that the processing times may depend 
on the customer class. (Furthermore, in more general models with heterogenous servers, the processing times 
may depend on customer class and server type combination.) The lack of literature analyzing multiclass 
models in steady state is unfortunate, since multiclass systems offer a richer set of models capturing, for 
example, call centers with agent skill and customer requirement heterogeneity. The results obtained for 
single class models for the steady state regimes, unfortunately, are not applicable in the multiclass setting. 
The original paper by Halfin and Whitt jHW81j relies on the Erlang's formula for the M/M/N queueing 
systems. |RPOO] only analyze the transient regime. The remaining aforementioned papers |Ree09j . jRPOOj . 
jJMM04| . |MM05| . jGM08| . [KR] . |KROT|, jGGllj covering the steady state regime also use the single class 
assumption in an important way. Thus a new set of tools need to be developed to address heterogenous 
models. 

In this paper we consider a multiclass queueing system with 0{r) parallel identical servers in the Halfin- Whitt 
regime, where parameter r — ^ oo and the system (nominal) utilization scales as l — 0{l/y/r). The multiplicity 
of classes comes from heterogeneity of customer mean service times. Namely, customers class i have the mean 
service requirement The arrival processes of different types are assumed to be independent Poisson 

(of rate 0{r)), and the service time distributions are assumed to be independent exponential. Class i 
customers waiting in the queue abandon the system at rate Vi > 0, also in the Markov fashion. An arbitrary 
non-idling, state dependent (in a sense to be explained) customer service (scheduling) policy is implemented. 
Interestingly, the details of this policy are irrelevant for our results. Moreover, it is allowed to have a different 
policy for different values of parameter r. Our results establish, in particular, that the steady state (random) 
queue length denoted by Q'^{oo) scales like 0(-y/r) as r — > oo. To be precise, we show that for some fixed 



parameter 6 > 0, limsup,.^3^E 



exp (j)r 2 Q''(oo)^ 



< oo, which in particular ensures that the sequence of 



distribution of {I / ^/r)Q^ (oo) is tight. If in addition, the scheduling policy admits a process level limit Q{t) 
of the processes Q^{t) = {1 / y/r)Q'^ (t) , then our results imply that any weak limit (along a subsequence) of 
the sequence of stationary distributions of Q'' is the stationary distribution of Q; in other words, we establish 
an interchange of heavy traffic and steady state limits. Thus our paper continues an earlier stream of works 
establishing interchange of hmits for queueing networks [GZ06] . }BL09j . |GM08| . |FPG08| . |KatlO| . 

Additionally, for the case when all abandonment rates Vi are strictly positive, we provide a sub-Gaussian 
bound on the tail of Q{oo), where Q{oo) is any weak limit of Q^{oo) = {l/y/r)Q'^{oo). A lot of recent 
literature focused on queueing models with abandonments |GMR02j , |DHj , |MM09| . It was observed that at 
a process level the presence of abandonments leads to a Ornstein-Uhlenbeck type behavior for the limiting 
process. Thus one would expect that the steady state measures (of the limit process) should have a sub- 
Gaussian tail. This was explicitly conjectured in |DHj . In this paper we qualitatively confirm the conjecture. 
One might naively conjecture, that in parallel to our exponential-tail result described earlier, one would have 



limsup^E exp y){Q'^{oo))^j < oo, for some small enough 0. But is does not hold even in the single-class 
model, and we provide a simple illustration why, later in the paper. However, we do show that any weak 
limit Q{oo) of the sequence Q^{oo) satisfies M[cxp{9{Q{oo))'^)] < oo for small enough 6 > 0. Namely the 
weak limits of the (scaled) queue length indeed have sub-Gaussian tails. 

The remainder of the paper is organized as follows. The model is described and the main results are stated in 
the next section. In Section[3]we obtain some preliminary results. Specifically, we obtain some useful bounds 
that follow from the lower bounds derived by comparing with the M/M/oo model, and also a monotonicity 
(with respect to abandonment rates) result. Our first main result on the uniform exponential-tail bounds 
is proved in Sections U] and [51 Another main result - the sub-Gaussian-tail bounds on the weak limits of 
stationary distributions, in the case of non-zero abandonment rates - is proved in Section [Sj 

We close this section with some notational conventions. For any real number 6, let 6"*" — max(&, 0),6^ = 
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— min(6, 0); [6J be the largest integer not greater than b, and [6] be the smaUest integer not less than b. 
M, ]R-|_, Z, Z_|- denote the set of real values, non- negative real values, integer values and non- negative integer 
values, respeetively. ^ denotes convergence in distribution. /{•} is the indicator function taking value 1 
when the event inside {•} takes place, and otherwise. 



We consider a sequence of queueing systems, indexed by parameter r = 1,2,..., increasing to infinity. The 
system with index r has iV = r + a^/r identical severs, for some fixed a > 0. (To be precise, this quantity 
needs to be integer, so it should be, for example, \r + ay/r] . This subtlety does not create any difficulties, 
besides clogging notation. To improve exposition, let us assume that r + a^/r itself is integer.) We assume 
that there is a finite set / of Poisson input customer flows i called classes with rates A^r, i € /. Each customer 
of class i € I has an exponentially distributed service time (requirement) with mean where (the service 
rate) parameter > 0. At any given time a customer is either in service (by one server) or is waiting 
in the queue of unlimited capacity; each server can serve at most one customer at any given time. If and 
when the cumulative amount of time the customer spends in service (which can, in principle, be preempted 
and resumed multiple times) reaches its service requirement, the customer leaves the system. Upon arriving 
into the system, for each class i customer a random patience time is generated according to the exponential 
distribution with mean where (the abandonment rate) parameter Vi > 0. If Vi = 0, the patience time 
is infinite. If and when the cumulative amount of time the customer spends in the queue (a customer can, in 
principle, move between queue and service multiple times) reaches its patience time, the customer abandons 
and leaves the system. Speaking less formally, a class i customer leaves the system in a small time interval 
dt with probability fiidt if it is in service, and with probability Vidt if it is in the queue. 

We assume that Ei \l l^i = 1- Then the nominal utilization of the system is 



namely the queueing system is in the Halfin-Whitt heavy traffic regime. Notice that when all abandonment 
rates Vi = 0, the nominal utilization is the actual average utilization. Introduce the following notations: 
Pi = Xi/ni (implying J^i Pi = 1): Mmin = mini M» and /imax = max^ ^i, = min^ Vi and z/max = max^ Ui. 
For every time t € R+ , let (t) be the number of type i customers in the system both in service and waiting 
in the queue, and ^'[(t) be the number of type i customers in service at time t. Then Q[(<) = Zl{t) — ^'[(i) 
is the number of type i customers waiting in the queue at time t. 

We now formally define a family of service disciplines under the consideration. Rather than specifying this 
family directly we describe the properties we want this family to satisfy. Namely, we take a very general point 
of view that the system evolution is described by some countable continuous time Markov chain, which has 
a projection {{Zl{t),i G I), (5'[(i),i € /)), and which satisfies Assumption [1] below. We then demonstrate 
that under many interesting policies, the corresponding Markov processes indeed satisfy this assumption. 

All formal results and proofs in this paper are concerned with abstract processes satisfying Assumption [1] 
Thus, the physical notions of customer arrivals and departures, introduced earlier in this section, can be 
viewed as no more than "interpretations" of increments and decrements of components Zi of the process. 
But, of course, it will be useful to keep such physical interpretations in mind, as they provide important 
insights into our methods. 

Assumption 1. Assume that for each r there exists a Markov process {X^(t),t € M+) in a countable state 
space with the following properties: 

1. Vector {{Zl{t),i e I),{W^{t),i & I)) G Z^^', such that *[(t) < Zl{t) for all i, is a deterministic 
function f of X^{t); this function is such that for every value w within its range, the pre-image 



2 Model and results 
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f^^{w) is finite cardinality. Vector {Q\{t),i G /) G z'^' is defined by Q\{t) — Zl{t) — "^\{t), and 
therefore is a deterministic function ofX^{t) as well. 

Intcrptctation: The process (Z,J'(t), ^'[(t), i G /), which describes the performance of the system we are 
interested in, is a projection of some "more detailed" underlying Markov process X^'{t). The number 
of states of X^it) that correspond to any given value of {Z^{t),'9l(t),i G /) is finite. 

2. The following relation holds: 

^vI;^(^)=mm{iV^5]Z[(^)}. (1) 

Interptetation: Whatever scheduling policy the process X^(t) "encodes", it is non-idling. 

3. The transition rates of the process X^(t) are such that, for any state X^{t): 

(a) The total rate of all transitions such that vector {Zl{t),i G /) changes to {Zl{t),i G I) + eg is 
X^r, where Bi is the i-th unit vector in R'-'^I. 

(b) If ZJi{t) > 1, then the total rate of all transitions such that vector {Zl{t),i G /) changes to 
{Zlit), I el)- ee IS ^JitW,{t) + y^Qlit). 

(c) The transitions such that any component of{Zl'{t),i G /) increases or decreases by more than 1, 
as well as transitions changing more than one component of {Zl{t),i G /), have zero rates. 

Interptetation: Scheduling policy is consistent with the notions of input processes, service times and 
patience described at the beginning of this section. Note that there might be positive rate transitions 
that "reshuffle" the values of occupancies {^l{t),i G /) in an arbitrary way, as long as conditions (QJ) 
and ^'^(t) < Zl{t) are not violated. 

4. Markov process X^(t) is irreducible. 

Intcrptctation: This condition is for convenience only - it allows us to claim not only existence, but also 
uniquenees of stationary distribution (as discussed below). Also, this condition is very non-restrictive 
- typically the "encoding process" X^(t) can be constructed in a way such that there is only one state 
corresponding to the "empty" system (with all Z^ = 0), and this state obviously is reachable from any 
other. 

Assumption [T] encompass a broad variety of non- idling disciplines, with or without service preemptions. For 
illustrative purposes, let us discuss the Class Priority (CP) and First-In-First-Out (FIFO) examples. The 
CP policy is fixed by setting a total order ~< on classes which without the loss of generality is assumed to 
be 1 ^ 2 -< • • • -< |/|. This means that the jobs in class |/| have the highest priority, the jobs in class |/| — 1 
have the next highest, etc. At any time, the servers give priority to the jobs with the highest priority in 
a non-preemptive or preemptive fashion. Namely, every server upon service completion inspects the queue 
and selects for service a job with the highest priority level, ties broken arbitrarily. For the non-preemptive 
version, once the service is initiated it is completed without interruption; in this case, we can simply take 
X'^{t) = {Zl{t), \['[(i),i G /). For the premptive version, if an arriving customer of type i finds all servers 
busy and if j < i, where j is the lowest priority being served, the arriving customer will force one of 
the type j customers out to the queue and replace it in service; in this case, the process is even simpler, 
X'^{t) = {Zl{t),i G /), because (\['[(i),i G /) is uniquely determined by {Zl{t),i G /). In either case, the 
"empty" state, with all Zl{t) = '^\{t) = 0, is reachable from any other, and therefore the chain is irreducible. 

For the FIFO policy, the statespace X"^ of chain X'^{t) is the set of finite sequences xiX2 - ■ ■ Xm, where 
Xn G I- Each sequence represents the set of customers in the system, in the order of their arrivals. The first 
min{m,iV''} customers are being served, and the remaining ones wait in queue. Clearly, {Zl{t), '^\{t),i G /) 
is uniquely determined by X^{t). The empty state is reachable from any other. 

We will now discuss several general properties of the process X'^{t) that follow directly from Assumption [1] 
For X G X"^ , denote by T{x) the set of states to which a direct transition from x is possible, and by T^^{x) 
the set of states from which a direct transition to x is possible. It is easy to observe that for any x both 
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T{x) and T~^{x) arc finite cardinality - this follows from the fact that there is only a finite number of states 
corresponding to each {{Zl{t),i G /), {'^l{t),i G /)), and then to each {Zl{t),i £ I), and direct transitions 
cannot cause any Zl{t) to change by more than 1. We can also observe that, starting any initial state, with 
probability 1 the process makes at most a finite number of transitions in any finite time interval; indeed, with 
probability 1 each Zl{t) remains finite on finite intervals, because the total rate of all transitions causing it 
to increase (by 1) is constant and equal A^r, and then the number of states visited on finite intervals is finite, 
from which we easily obtain that the number of transitions is finite as well. This means that the process 
satisfying Assumption [1] is well defined by its transition rates - with probability 1 there are no "explosions". 

Since the system nominal utilization is strictly less than 1 and condition ([T]) must hold, the total workload 
(expected unfinished work) J2i ^i(J-)/l^i must have a negative average drift, as long as J2i ^1 (J-) / f^i ^ 
/ fJ-min- (The latter condition implies ^ii^) ^ in which case the average rate at which unfinished 
work in the system is processed is strictly greater than the average rate at which new work arrives.) This, 
along with the fact that for any K > there is only a finite number of states with J2i ^ ^ i ^-^d the 

assumption that Markov chain X'^{t) is irreducible, implies (using standard methods) that X^{t) is positive 
recurrent with a unique invariant probability distribution t:^ . From now on we write X^{oo) for the steady 
state version of X^{t). The same applies to the variables determined by X^{t). For example Q^{oo) denotes 
the steady state queue size. 

We remark that the irreducibility assumption is made to simplify the exposition - it is non-essential, in the 
following sence. If we do not require irreducibility, it is easy to show (again, using standard methods) that 
Markov chain X'^{t) has at most a finite number of classes of communicating states, reachable w.p.l from any 
transient state. Restricted to any of those state classes, X^(t) is positive recurrent, with unique stationary 
distribution. Thus, stationary distributions of X^{t) exist and are characterized as convex combinations 
of a fixed finite set of distributions. All results of this paper would still hold if instead of the stationary 
distribution we would consider a stationary distribution. 

Next we discuss some properties related to the (infinitesimal) generator A'' of the Markov process X^{t). 
The domain of generator might not contain all functions F : — > R. However, the following operator 
is defined for any function F: 

A^Fix)^ ^ ax,y)iF{y) ~ Fix)), x e X\ 
yeT{x) 

where ^{x,y) is the transition rate from x to y. Given properties of our process X^{t), the following property 
is easily verified directly: any function F, which is constant everywhere except a finite subset of , is within 
the domain of A^ and, moreover, 

A'Fix) = A^'Fix), yx, 
EA'-F(X'-(oo)) = Ei'-F(X'"(oo)) = 0. (2) 



Let us additionally denote $[(t) = Zl{t)/iJLi. Namely, $[(i) is the total workload at time t associated with 
class i jobs - the sum of expected remaining service times of all class i jobs present in the system at time t. 
The total workload is $''(t) = Y.r ^[(0- 

Now let us introduce the diffusion sealed version of our processes: 

\Jr Vr Vr [ii ^Jr 

Furthermore, let Z''(<) ^ J2^ZI{t), $"■(*) = E^^KO, Q^'it) = HiQli^)- Namely, Z''(f) is the diffusion 
scaled total number of customers in the system, [t) is the diffusion scaled total workload in the system, 
and [t) is the diffusion scaled total queue length. Our method of proof is based on the Lyapunov function 
technique. We will be considering Lyapunov functions of the form exp(0$'') and exp(0($'')^). The random 
variables Z''(<), Z''(i), $[(t), etc., corresponding to the steady state regime are denoted using the same 
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notation, except oo replaces t. For example Z^{oo) is the steady-state number customers in the system after 
the diffusion rescaling. In addition, we write Z''~''^{oo) to mean {Z^ (oo))^ , Zl'^{oo) to mean (^,[(03))+, etc. 

We now ready to state our main results. 
Theorem 2. The following properties hold. 

(i) If Vi < /ii for all i (including possibly Vi ~ for some i), then for every 9 > 



limsupEexp j 9'^^Zl' (00) j < 00. 



(3) 



(ii) There exists 9 > such that for every 9 £ [0, 0] 



limsupEexp j ) < 00. 



(4) 



(Hi) There exists 9' > such that for every 9 e [0,6*'] 



limsupEexp I (00) J < 00. 



(5) 



(iv) In particular, the sequence Z^{oo),r € Z+ is tight. 



Our proof approach can lead to explicit bounds on 9 and 9' . While these bounds can possibly be improved, 
we do not pursue here a goal of finding the sharpest bounds. Clearly, statement (iv) is a corollary from (ii) 
and (iii), because |Z''(oo)| < + ^'^d then 



lim supEexp 6l|Z''(oo)| 

r — ^no ^ 



< 00, 



for sufficiently small > by application of the Cauchy-Schwartz inequality. The proof of (i) will follow from 
a simple comparision to the infinite-server system. The proof of (ii) will rely in essential way on statement 
(i). Finally, the proof of (iii) will rely on statement (ii). 

Theorem [2] shows, in particular, that in the Halfin-Whitt heavy traffic regime the steady state total queue 
length Q^{oo) scales like 0(-y/r), because 

0*^(00) = (Z'^(oo) - r - a^Yl^ 
< (Z'^(oo)-r)+/Vf 

= i"-^+(oo). 

Furthermore, our result implies that Q^{oo) decays at an exponential rate: 

P (Q^'ioo) >x^<ci exp{-C2x), 

for some constants ci, C2 > uniformly in r. The steady state number of idle servers, (r + ay/r — Z^{oo))~^ , 
also scales like 0(-y/r), because it is upper bounded by a^/r + J2i i'^)V^- 

The tightness of the sequence Z^(oo) implies the existence of at least one subsequential weak limit. Namely, 
there exists a subsequence r„,n G and a random variable denoted by Z(oo), such that Z''{oo) ^ Z{oo). 
Such a limit is not necessarily unique as it may depend on the details of the scheduling policy. Then, 
Theorem [2] implies the following 

Corollary 3. For a sufficiently small fixed 9 > and every weak limit Z{oo) of the sequence Z^{oo), 
E[exp(6l|Z(oo)|)] < 00. 
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Proof. Fix positive 6 < miii{9,6'). Fix arbitrary k > 0. If Z^{oo) converges weakly to ^(oo), then by the 
Bounded Convergence Theorem. 



E 



niin I exp(0|Z(oo)|), k 



hni E 



(exp(6'|Z'-(oo)|),fc)l < hnisupE [exp(6l|i"'(oo)|) 



where the RHS is finite and does not depend on k. It remains to take the limit of LHS on A: — > oo and use 
the Monotone Convergence Theorem. □ 



Theorem [5] leaves open the question whether ([5]) holds for all 9. (Equivalently whether ^ holds also when 
some i^i > fii.) We conjecture that it is the case, but we are currently unable to verify this statement. 

We now turn to the case when every customer class has strictly positive abandonment rate: Vi > 0. In this 
case, even tighter bounds on any weak limit of the stationary distribution can be obtained. It is known 
that the presence of abandonments changes the properties of the tail of the distribution of Z'^{oo). As 
an illustration consider a single class model M/M/N"^, where the abandonment rate v = n for simplicity. 
It is straightforward to see that Z{qo) has the same distribution as in the M/M/oo system, namely it is 
Poisson with mean Ar//i = r. As r — > oo the distribution of Z^ipo) then approaches a standard normal 
distribution. Thus we might expect the tail P(Z''(oo) > x) to decay at the rate exp(— 0(a;^)). Namely, 
one might conjecture the following analogue of Theorem [2] - there exists a sufficiently small 9 > Q such 
that sup^ E[exp(6'(Z''(oo))^)] < oo. However, this cannot be the case - if random variable G has Poisson 
distribution with mean r > 0, then E[exp(0G^)] = oo for every 9 > Q. Nevertheless, we can show that the 
following analogue of Corollary |3] holds. 

Theorem 4. For every subsequential weak limit Z{oo) of Z^'(oo),r e the following properties hold, 
(i) If Vi < fii for all i (including possibly vi = for some i), then there exists 9' > 0, such that for every 
9 G [0, 9'] 



-exp 



Z-(oo) 



< oo. 



(ii) Suppose Vi > Q for all i £ I . Then there exists 9 > Q such that for every G [0, 



Eexp 61 Z+(oo) < oo 



(6) 



(7) 



This result shows that, while the presence of abandonments does not change the tail decay rate of Z'"'+(oo) 
for each r, the decay rate of the tail of the weak limit Z"''(oo) is faster - it is Gaussian rather than simply 
exponential. This, in particular, implies that 

P {q{oo) >x^< C3exp(-C4a;^), 
for some constants C3, C4 > 0, where Q(oo) is any weak limit of Q^{oo). 



3 Key bounds and monotonicity properties 

We begin by establishing a few technical results. For the remainder of the paper we drop for convenience 
the (00) and superscript r notations, and simply use Z,Zi^Zi,(^i, etc. to denote our steady-state variables. 
The same applies to the generator A and operator A - the superscript r is dropped. 

Lemma 5. Suppose Vi < fii for all i. Then for any 9 > 0, 

lim sup Eexp (eiZr) < exp(p,6'V2) + 1, (8) 



7 



and 

limsupEcxp(6i^ Zr) < Y[[cxp{p,d^ /2) + 1]. (9) 

r— f oo 

Proof. We obtain the required lower bounds by comparing with a system with infinitely many servers. 
Namely, in addition to the original system, i.e. the process X(t), which defines it, consider the system with 
the same arrival rates, same mean service times, same (exponential) service time distributions, but with 
infinite number of servers. Let Gi be the steady-state number of customers in service in this infinite server 
model. Then, each Gi has Poisson distribution with mean pir, and all G^'s are independent. 

Given the Vi < fii assumption, clearly we can construct both the original and the infinite-server processes on a 
common probability space in a way such that, w.p.l Gi{t) < Zi{t) for all t. That is, we can construct a "joint" 
Markov process, for which the original process X{t) and the infinite-server process are different projections. 
Given that X(t) is irreducible and positive recurrent, we can make sure that the constructed joint process 
is also irreducible and positive recurrent, and thus has a unique stationary distribution. Then, the relation 
Gi < Zi holds in the stationary regime as well. Then also Gi < Zi, where we denoted Gi = {Gi — pir)/y/r. 
Since Gi has Poisson distribution with parameter p^r, for any real 0, 



Eexp(6iG',) = cxp -9p,V^ - pir{l - e'^/^'') — ^ exp{p,e^/2). (10) 

Using Zi > Gi, ([TU)) immediately implies, that for any >Q, 

limsupEexp(6'i-) < limsupEcxp(6lG'-) < cxp{pi9^/2) + 1, (11) 

r— foo r— fCJO 

(where we used exp{6GY) < 1 + cxp(— 6'Gi)) and 

limsupEexp(6i^Z-) < limsupEexp(6l ^ G") < ]^[exp(pi6lV2) + 1]. (12) 

r— )-oo r— ^oo 

□ 

Next we obtain a bound which, roughly speaking, says that, when all I'i < p-i, it is unlikely for <I> to be large 
if Z is not large. 

Lemma 6. Suppose Vi < pi for all i. For arbitrary b > 0,9i > 0, and n € there exists C = C(b,0i,n) 
such that for all 9 e [0, 9i\, 



lim sup E 

r— f oo 

Proof. Inequality 



I{Z<b}{Y^Z-rexpi0^) 



< C. (13) 



(1/A^min) - (1/Mmax) ^^ ^ ^ (14) 

i i 

holds always. Condition Z < b is equivalent to 

^Z+-^Z,-<6. (15) 

i i 

Multiplying ([T5|) by (l//imin) and combining with (HH), we get 

$ < (1/Mmi„ - 1/Aimax) ^ Z' + (1/Mmi„)&. (16) 

i 

Applying bound ^B)) to the left-hand side of p^ . and then using (0), we obtain p^ . □ 
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Finally, we will need the following monotonicity result. It says, roughly speaking, that for any well-defined 
system (i.e., a process satisfying Assumption [T]) there always exists another well-defined system with smaller 
abandonment rates, in which the number of customers of each class is larger. It is important to note that 
Lemma [7] does not imply that this monotonicity works in the "opposite direction": namely, it does not imply 
that for any system there exists another system with larger abandonment rates, in which the number of 
customers of each class is smaller. 

Lemma 7. Consider a process X{t), satisfying Assumption[^for a given a set of parameters r, a, N, /ii, i>i, i G 
/. Suppose we have a modified set of parameters r, a, fii, i I , with v'^ < v for all i. Then there exists a 
Markov process X'{t) with associated Z[{t), '^'i{t), satisfying Assumption]^ with the modified parameter set, 
and such that the following holds. The processes X{t) and X'{t) can be constructed on a common probability 
.space in a way such that, first, with probability 1 Zi{t) < Z^{t) and '^i{t) < for all i and t, and, second, 

the joint process {X{t), X'{t)) is an irreducible positive recurrent Markov chain. 

Note that the lemma claim that the joint process {X{t),X'{t)) is an ergodic Markov chain, allows us to 
conclude that the steady-state versions X{oo) and X'{oo) can be constructed on a common probability 
space in a way such that Zi{oo) < Z'j{oo) and 4'i(oo) < '^'^{oo) for all i. 

Before giving a proof, we informally describe the simple intuition behind it. Given a queueing system corre- 
sponding to parameters r,a, N , ^,i,Vi,i € /, operating under any scheduling policy so that the Assumption 
1 is valid, consider a modified system constructed as follows. Assume for simplicity that Vi > Q for each i. 
Upon every abandonment instance of a system (which happens with rate Vi for each class i customer waiting 
in the queue), customers abandon only with probability v' /v and with the remaining probability (1 — i^' /i^) 
join a new "virtual" class i pool of customers, which we call class i' ,i € / customers, with some abuse of 
notations. The decision is done independently for all customers. We assume that the class i' customers for 
any i g / have lower priority than all the customers in classes j € I and priority mechanism is preemptive 
resume. Thus the portion of the system corresponding to classes j ^ I only is the same as the original 
system. The service times of class i' customers are assumed to be exponentially distributed random variable 
with parameter /i^. Additionally, class i' customers abandon with rate v'^. It is easy to see that each queued 
classes i customer abandons with rate Vi] and each queued customer of class i or i' abandons with rate i>l, if 
we do not count an i-to-i' conversion as an abandonment. This mechanism induces a new queueing system 
such Z,{t) < Z[{t) = Z,{t) + Z,'{t) (and similarly for 

Proof. The states X'{t) of the modified process are defined as augmented states X{t), as follows: 

r{t) = [x{t),{zl{t), 

where {Z'^{t), i G /) is a vector such that Zi{t) < Z[{t) for all i. (Recall that X{t) uniquely determines the 
associated Zi{t), 4'i(i), i E I. Therefore, corresponding to any state of X{t) there is a countable set of states 
of X'{t).) Now, consider an arbitrary fixed function, that maps X'{t) into an integer vector {^j{t), i € /), 
while satisfying the following conditions: \I'i(t) < ^'^-(t) for ah i; = "^^'^{^yJ^i^iW}- (The 

deterministic mapping of X'{t) into {Z^{t), i G I) is the projection.) Recall notation Qi{t) — Zi{t) — '^i{t), 
and denote Q[(t) = Z[{t) - ■^'■{t). Observe that we always have Q.,{t) < Q[{t); indeed, if Y.i *»(0 < ^ then 
all Qi{t) = 0, and if X]j*i(t) = N, then by construction > = which coupled with 

Ei*'i(0 < N implies *,(t) %{t) for aU i. 

We will now define the transition rates of process X'it); they will be such that the order relations Zi{t) < Z[{t) 
are preserved. We will use time indices t— and t for a state just before and just after a transition at time 
t. The transitions will be of two types. The first type transitions are "driven" by those of process X, and 
have the same rates. When X makes a transition from X{t—) to X{t), such that Zi{t) = Zi{t—) for all i 
(no "arrivals" or "departures" in the X-process), or Zi{t) = Zi{t—) + 1 for one of the i (an "arrival" in the 
X-process), then X'{t) = {X{t), {Z[{t), i € /)), where each Z[{t) = Z[{t-) + Z,{t) - Z^{t-). (Simply put, 
in X' we make the same change of X-component and increment Z'^s, in the same way.) When, X makes a 
transition from X{t—) to X{t), such that Zi{t) = Zi{t—) — 1 for one of the i (a "departure" in the AT-process), 
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say i = j, then X'(t) = {X{t), {Z[{t), i G /)), where Zl{t) = for all i ^ j, and Z[(t) is set to Z[(t-) 

or Z[(t—) — 1 with probabilities 

respectively. (In the expression for p the Vi in both the numerator and denominator cancels out - we left it 
there to make the meaning of probability -p transparent. In particular, the expression does not require that 
Vi > 0. We also do not need to "worry" about the case when ViQi{t—) + ^i'^i{t—) = 0, because in this case 
a "departure of class i" transition in X is impossible, and we only define p for such transtions.) 

The second type transitions are associated with each customer class j (these are the "departures" in the 
X'-proccss only); namely, with the rate v'^{Q'^{t—) — Qj{t—)) + pj{'i>'j{t—) — 'i/j{t—)) the transition form 
X'{t-) to X'{t) is such that X(t) = X{t-), Z'-{t) = Z'j{t-) - 1, and Z[{t) = Z',{t-) for ah i ^ j. 

The Markov chains X'{t) and (its projection) X{t) are constructed on the same probability space. The 
order relations Zi{t) < Z[{t) are preserved for all i at all times, by construction. By construction the process 
X{t) is defined "as itself". It it easily checked that the process X'{t) satisfies Assumption [1] including 
the irreducibility condition. Therefore, X'{t) is positive recurrent. Since X{t) is a projection of X'{t)^ the 
process X'{t) itself can be taken as the joint process {X [t) , X' [t)) . The proof is complete □ 



4 Proof of Theorem [2](i) and (ii) 

Statement (i) follows from Lemma [5] 

To prove statement (ii) it suffices by to Lemma [7] to consider the case when all Vi = Q, which is what we 
assume for the rest of the proof. Consider the process in the stationary regime, i.e. x is random with the 
distribution equal to the stationary distribution tt of the Markov chain. First, for every state x X we have 



A^x) = -L[^(A,r)M - *^(^)] = -^-(^) 



where Za{x) = min{Z(a;), a}. We remark that this expression docs not require chain X{-) to be in steady- 
state. 

Consider a (candidate) Lyapunov function exp(6'$(a;)) for every state a; e A", where 6* > is for a moment 
arbitrary. We use the Taylor expansion 

exp(6ly) = exp(6ia;)(l + 6i(y - x) + {l/2)e^{y - xf exp(6lz)), 

for some z satisfying \z\ < \y ~ x\. Then exp{6y) < exp{9x){l + 9{y — x) + (l/2)6'^(y — x)^ cxp{9\y ~ x\)). 
We will apply this for x ~ ^{x), y ~ ^(y), where y G T{x). We obtain 

Aexp{e^x)) < cxpiO^ix)) [eA^ix) + {1/2)9^[Y + (r + aV^)/^max](M^L/V^)' cxp{e ^l^lJ ^T)] (17) 

i 

where we use the fact that |y — a;| < 1 / (fiminVr) , and J2i ^i''" + (j' + aAA')/^max is a crude upper bound on 
the maximum transition rate (involving a customer arrival or departure). We obtain 

Aexp{e^{x)) < exp{e^{x)) \ - eZa{x) + (1/2)6*201] , (18) 

where, uniformly on all r > 1 and all < 1, 



Cl = [Y + (1 + «)Aimax j f^Jn CXp(Mmin)) > ^' + + a/\/^)Mmax ^ 



AimLcxp(6i/^J„/%/F). 
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In the rest of this proof we only consider < 1. 



Let <iE>(fc)(a;) = min{<iE>(a;), fc}. Clearly, exp(0$(;;) (a;)) is constant everywhere except a finite subset of state 
space X, because (Assumption [Ij there is only a finite number of states x E X for which ^ Zi{x)/ jii < k. 
Therefore, © holds for the function exp(6'$(fc) (a;)). 

Observe that l>(a;) > k implies Aexp(0l>(fc)(a;)) < 0, and ^{x) < k implies A exp(0$(fc) (a;)) < Acxp{9^{x)). 
Then, from (|T8)) we obtain: 



lexp(6'l>(fc)(a;)) < I{^(x) < k}I{Z{x) > a} exp(6'l>(a;)) - Oa + {l/2)e'^ci 
+ I{Z{x) < 0} exp(6l$(a;)) [ - 9Z{x) + {l/2)e^ci 
+ /{0 < Z{x) < a} exp(6'$(a;)) [(1/2)6*201 



(19) 
(20) 
(21) 



For the process in steady state, all terms (|T9)) - ([2T|) have finite expected values for each k and r, including 
the left-hand side of (|19p . Indeed, the left- and right-hand sides of are bounded, and (pil)) and (PT|) are 
non-negative and have finite expectations by Lemma [B] We now take the expectation w.r.t. the stationary 
distribution tt on A" of both sides, use E[Acxp{9^(^k){x))] = (which follows from and cancel 9. 

Recalling our notation $ = $''(00), which is the same as 't{x), where x is distributed according to the 
stationary measure tt, we obtain 



E /{$<fc}/{Z> a} exp(6'$)(a- (1/2)6*01) < 



(22) 



E /{Z < 0}exp(6l$) -Z+ (1/2)6*01 



(23) 



E /{O < Z < a} exp(6'l>) (l/2)6lci . (24) 
Now, let 9 — min{a/ci, 1}. Then By LemmalHl we have 

limsupE \l{Z < 0}exp(6'$)[- Z + (l/2)6'cijj < C2(a,ci), 

ft L J . 

limsupE /{O < Z < a} exp(6'$) (1/2)6*01 <C2(a,ci), 

r L L J . 

for some 6*2(0, ci) < 00. On the other hand 9 = a/ci implies that for any 9 £ [0, 9], a — (1/2)6*01 > a/2 > 0. 
Thus 

limsupE [/{<! < k}I{Z > a}exp(6'$)j < 63(0, ci) < 00, 

r L 

for some C3(a,ci). Observe that this bound does not depend on k. Thus fix tq large enough so that for all 
r >ro 



E 



/{<! < k}I{Z > a} exp(6'l>) < 263(0, ci). 



By Monotone Convergence Theorem, taking fc — > cxj, we obtain 



E 



/{Z > a} exp(6'l>) < 263(0,01), 



namely 



lim sup E 



I{Z > a}exp(6l$) 



< 00. 
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Again applying Lemma [SJ we have 



lim sup E 



I{Z < a}exp(6i$) 



< oo. 



Combining, wc obtain limsup^E cxp(0$) 



< oo. 



To complete the proof of the theorem, take any 6 < 6 and p = p{6) > 1 and such that p9 < 9; and then q 
such that 1/p + 1/q = 1. Using Holder inequality, we have 



Eexp(6l^(l/^,)Z+) =E 

i 

By Lemma [5] we have 
from which we obtain 



exp(0<i.)exp(0^(lM)4^) 



< 



Eexp(]36i$) 



i/p 



Eexp(g0^(l^,)4") 



1/-3 



lim sup E 



lim sup E 



cxp(g0^(l/Ai.)4- 



< oo, 



< oo. 



This proves The proof of Theorem [^Jii) is complete. 



5 Proof of Theorem [2](iii) 
5.1 Auxilliary results 

Lemma 8. For any 9 > and any r, the stationary distribution is such that 

¥,A exp (-61$) = ^7r(a;)^ 



(25) 



Proof. The case 6* = is trivial. For the rest of the proof, consifer a fixed pair of 6* > and r. (The chosen 
constants may depend on 9 and r.) 

Consider a fixed c > and any state x such that ^{x) > c. Then, it is easy to observe that for some fixed 
C20 > 0, C21 > 0; and any k > c. 



Acxp{~9^{x)) < (c2o$(a;) + C2i)exp(-6'$(a;)), 



^exp(-6l$(fc)(a;)) < (c2o4(a;) + C21) cxp(-6i$(a;)). 



(26) 
(27) 



Indeed, the total rate of all transitions out of state x that may change the value of $ is upper bounded by 
C2o^{x) + C21 for some constants C20 > 0, C21 > 0. (From $ = J^A^i ~ P^AI (MiaA") we get an upper bound 
on Z, linear in which gives the bound on the customer departure rate; the arrival rate is constant.) Also 
^{y) > ^(x) - l/(/Ltmin\/r) > ^ix) - \ j [Laxia for any State y € ^"(a;)- Therefore, 

iexp(-6l$(a;)) < (c2o$(a;) + C2i)2 exp[-e'($(a;) - l/Mmin)], 

where the factor 2 exp(0//injin) can be dropped by rechoosing C2o,C2i. This proves (|26p . and (|27p is proved 
the same way. 
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From (1^51) and (P7|) wc conclude that the values of 

^exp(-6'<i>(a;)) and Aexp(-6'$(fe)(a;)) 

are uniformly bounded for all x and k. (Recall that the number of states with ^{x) < c is finite, for any c.) 
This means, in particular, that the sum in (j25p converges absolutely. 



We know that 



Eiexp(-0$(fc)) =0, 



(28) 



by ([2]), because exp(— 6'$(fc)) is constant outside a finite set of states. The LHS of ((28|) can be written as 



'{k) 

EAexp(-6'l>(fc)) = ^ 7r(a;)Aexp(-0$(a;)) + ^ 7r(a;)A exp(-0$(fc) (a;)), 



(29) 



where Bi{k) is the set of states x such that a; and all y £ r(a;), are within set B{k) = {w \ ^{w) < k} (so 
that Bi{k) C B{k); B2{k) is the set of "boundary" states x for which there exists y E T{x) such that either 
X G B{k) or y £ B{k), but not both. As fc — > oo, the sum over Bi{k) converges to the sum in (|25p . and the 
sum over B2{k) vanishes. This proves □ 

Lemma 9. For arbitrary 6 > and n G Z_|-, i/iere exist 62 = 92{b,n) > and C ~ C{b,n) such that for all 



lim sup E 



i{z>-b}iJ2z+rexpi-e4>) 



< c. 



(30) 



Proof. The proof is analogous to that of Lemma [SI except instead of relying on the bound which involves 
Z^' and holds when all Vi < Hi, we will use bound (|3]), which involves Z^ and holds for arbitrary Vi > 0. 
Namely, from Z > —b we obtain 



$ < (l/A^min - l//imax) Z+ + (1/Mmi„)& 



(31) 



similarly to ([T6l). Then applying bound (|3ip to the left-hand side of ((30|) . and then using (|4]), we obtain 
O- □ 

5.2 Proof of Theorem [2](iii) 

For every state x G X wc have 

A^{x) = -^[^(A,r)/^i -^^.(a;) -Y^u,Q^{x] = -Za{x) - ^MiOj(a;), 



Consider a (candidate) Lyapunov function exp(— 6'$(a;)), with 9 > {). Then, analogously to p7)) we obtain 
Aexp(-e'l>(a;)) < exp(-6'$(a;)) [ - M$(a;) (32) 

+ (1/2)^' E ^'■'^ + + «\^)A'max + t^max^ 0»(a;)](/i-i„/V^)2 exp(0Ai,^l„/yf )] , 

i i 

where the crude estimate of the maximum total transition rate in the ff^ term accounts for the transitions 
due to abandonments as well. In turn, p2[) can be rewritten as 



Aexp(-0$(a;)) < exp(-0$(a;)) \6Za{x) + 0^ i/,Q,(a;) + 6''[cii + C12Z+] 



(33) 
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where cn > and ci2 > arc constants (independent or r), and the inequahty holds for all sufficiently large 
r. Finally, we fix arbitrary b > and rewrite (|33p as 

(34) 



Aexp{-0^{x)) < I{Z < -b}exp{-0^{x)) 9(-b) + 0^cn 



I{Z > -b}cxp{-e^{x)) 



0a + 0C13 



Z+{x) + 0^[cn+ci4^Z+{x)] 



(35) 



where C13 > and C14 > arc constants independent or r. 

We now consider our system in steady state. The LHS of ([M)) has expected value by Lemma [5] For all 
sufficiently small 9 > 0, (j35p has expectation bounded uniformly in r by Lemma [HI Further, let us restrict 
ourselves only to small values of such that b — Ocu > C15 for an arbitrary fixed constant < C15 < b. 
Then, the RHS of (p4|) has a well defined, strictly negative expected value. (At this point we do not claim 
that the expectation is finite - that will follow shortly.) We take the expectation of both parts of (|Ml) - (|35p . 
cancel 0, move (what is left of) the term ([Ml) to the LHS of the inequality, and divide the inequality by 
b — Ocii > C15 > 0. Letting r — > cx3 and applying Lemma [Hi gives us 



lim sup E 



Again applying Lemma [HI we have 



lim sup E 



I{Z < -b} exp(-e'l>) 



I{Z > -&}exp(-e'$) 



< 00. 



< 00. 



Combining, we obtain limsup^E exp(— 0$) < 00. From this, the required bound ([5]) for sufficiently small 

> 0, follows by using the identity J^i /^i = — $ + J2i / i^i^ property and Holder inequality. The 
proof is complete. 



6 Proof of Theorem |4] 



Statement (i) of the theorem follows from the following result, which is a stronger version of Lemma [S| 
Lemma 10. Suppose Vi < fii for all i. There exists a sufficiently small > such that, for each i, 



lim sup E 



exp(0(Z-) 



< 00. 



(36) 



Given the fact that the vector [Z^ , i G I) in Lemma [TOl is stochastically dominated by (Gj , i £ I), where 
Gi — {Gi — pir)/ and G^'s are independent r.v. with Poisson distribution with mean p^r, this lemma in 
turn is a corollary of the following asymptotic property of Poission distributions. 

Lemma 11. Consider a family of Poisson distributed random variables H{p) with mean p > 0. Denote 

K = hn{p) = HH{p) = n} = e-V77i!,n e Z+. 
Then, there exists a constant G > 0, such that for all sufficiently large p and all n < p, 

/i„ < G^e-("-?')'/(2p)_ (37) 

Consequently, for any < < 1/2, 

limsupEe^[(^(f)-f)~l'/^' < 00. (38) 
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lim hn 



Proof. Denote m = [pj . Using Stirling formula for the factorial in hm ~ e Pp"^ /ml, we directly verify that 
in particular, for some constant Ci > and all large p 



= 1, 



h,n < Cl 



1 



(39) 



Therefore, to show (p7| . it will suffice to show the existence of C2 > such that for all large p and any 
n < m, we have 

/i„//i™ <C2e-("-f)'/(2p). (40) 

We only need to verify (|40| for n < m, because (m — pY /{2p) — as p — >■ 00, so that the case n = m can 
be covered by rechoosing (increasing) C2 if necessary. We have 



log(ft,„//i,„) = log TT - = log(l - — ^) < - y] - — - = -^{m-n){p-m+p-n-l 



p- ] 



1 



p 



p 



p 



2p' 



j—n+l J— n+1 ^ j—n-\-l 

Note that e = p — m E [0, 1). Substituting m = p — e in the RHS of the above inequality, we see that it is 



for all p > 1. We proved ([371 
To show (I38D. we can write 



n<p 



Vp Vp 



n<p~ 



It remains to observe that 



-{i/2-e)c 



□ 



Thus, statement (i) of the theorem is proved. In view of Lemma [71 to prove statement (ii), it suffices 
to consider the case Vi < fii for all i. Then the following proposition will imply statement (ii) almost 
immediately. 

Proposition 12. Suppose, < vt < fXi for all i. There exists 6 > and co > such that for all G [0,0] 
and k 



lim sup E /{$ < fc} exp(6'$2 



< Co, 



lim sup E 



/{$<fc}exp(0(^Z+M 



< Co. 



(41) 
(42) 



Proof of Proposition [7H Property (|42p follows from Lemma [TUl ([^T]) and application of Cauchy-Schwartz 
inequality because 

(^ z+/f,,r = (* + E ^^/t"^^' ^ + 2|/| ^(z-M)'. 
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Thus, the main bulk of the proof is devoted to (|4ip . 

We first write the expression and derive bounds for A^. We have (using notation ^' ~ J^i ^i) foi' every state 



AHx) = -L[^(A,r)M - J2 - E(^'( 



x) - ^,{x))u,/^l,] (43) 



< ^[r - ^(a;) - i^,„i„/Aimax(^(a;) - 'J' (a;))] 



+ 



Now we have 



- min{Z(a;), a} - Vmin/ i^m2.^{Z{x) - a) 



Since (a; — a)+ is a monotone function, we obtain a bound 

A$(a;) < - min{Z(cc), a} - (l'min/imin/Aimax)'^+(a;) + (j^min/Mmax) E (^) + (^'min/A*max)a 

i 

^ - min{Z(a;), a} - ci$+ + ca E ^^(^) + ^3- (44) 



Similarly to (|44)) we can also obtain a lower bound on A^. Namely, from (|43l) we get 

A$(a;) > - min{Z(a;), a} - i^ma^/ fimin{Z{x) - a)+, 
which, using Z{x) < Z^{x), implies 

A^{x) > -min{Z(a;),a}-C25E^^^(^)' (4^) 

where C25 = t'max/Mmin- 

Consider a (candidate) Lyapunov function exp(0$^(a;)) with < < ^ where 6 will be implicitly defined 
below. (Below we use the phrase "for sufficiently small 6 > 0" to mean "for all 6 G {0,6], with 9 rechosen 
to be smaller, if necessary.") Without the loss of generality we assume < 1. We have for h{x) = exp{9x^) 
that dh/dx ~ 29xcxp{6x^) and dl^h/dx^ — 26exp{9x^) + iO'^x^ cxp{9x^). We use Taylor expansion 

exp(6ly2) = exp(6lx2) ^1 + 2ex{y - x) + ^{29 + ^6'^z^){y - xf ex^iOz^ - Bx^) 

for some z satisfying \z — x\ < \y ~ x\. We have z"^ — x"^ = [z — x){z + x) < 2\y — x\{\y\ + \x\). Then 
exp(6'y2) < exp{9x^) (l + 2ex{y - x) + {9 + 29^{\x\ + \y- x\fiy - xf) ex-p{02\y - x\{\y\ + \x\))) 

Let ^(k) = min($,fc) and let us apply the above inequalities for x = $(fc)(a;) and y = (y), where 
y e T{y). We have |^(y) - ^{x)\ < A*mL/V^ implying the same for 'l(fc). Then 

max{$(fc)(y),l>(fc)(a;)} < /i-J„/x/f +fc, 

and 

min{$(fc)(y),$(fc)(a;)} > -^-{x) - fi^ljV^: 
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This imphes 

2|$(fe)(y) - $(fc)(a;)|(|$(,)(y)| + |<i>(,)(a;)|) < ^[l^^Jr + ^l;^,^k| ^ + ^l^J>- {x)/ ^. 
For sufBciently large r whieh depends on k and model parameters, we obtain even a cruder upper bound 

2|$(,)(y) - 4(,)(a;)|(|$(,)(y)| + |'l>(fe)(a;)|) < ^~ {x) + 1 

giving 

exp(02|$(fc)(y) - <l(fc)(a;)|(|<l(fe)(y)| + |l>(fc)(a;)|)) < exp(0<i.- (a;) + 0). 

Note that, given fc, the value of $(j.)(a;) can change after a direct transition only when J2i ■^ii^) / l^i — 
k + l/nmim implying Z < r + /imax(fc + 1 /Mmin ) ■ Therefore, uniformly on all states x, the total rate of 
all transitions that can possibly change the value of $(fe)(a;) is upper bounded by 

r'^Xi + {r + aV7-)/^max + V^/^max(fc + ^ l^i < CiT, 

i i 

for the appropriate choice of positive constant C4. Also, 

($(fc)(y)-$w(a^))'<l/(A^ii„0- 

Therefore, the product of the rate of transitions (which can change <&(fc)) and the value of ■)(y) — $(-j,')(a;))^ 
is upper bounded by c^/^'^^i^. Assembling all the above estimates, we obtain 

AeMd^U^x)) < 20^^,^{x)[A^^,^{x)]eM0^k)i^)) 

+ ecfx^^ exp(0|.- {x) + 9) exp(0<|2,, [x)) 

+ 2eW^(u){x)\ + t^~lr-'^')' exp(0$-(a;) + 9) exp((?<|.2^ (a;)) 

< 20l>(fc) {x) (a;)] exp(^l>^^ (a^)) 

+ 9c5 exp{9^-{x)) exp(^l>^^ {x)) 

— /'™\\ ^n^, 

'(k) 



where we have incorporated into constants C5 and cg. This is possible by our assumption 9 <1. Further- 
more, for large enough r we have have Mmin?'^^^^ < 1- Thus (|<l>(fc)(a;)| + A^mfn''"^^^)^ — '^^'{k)^^) + 2' ^"^"^ 
for the appropriate choice of constants cy and cs, we obtain 



AeMO^\k){^)) < 2(?<i>(,.)(a;)[A$(fe)(a;)]exp(0$2^.)(a;)) 



+ 6'c7 exp(6'l>- (a;)) eM^^k) i^)) 



C80^$^,) (a;) exp(0$" (a:)) exp(0$^,) (a;)) 



Now we will use appropriate bounds on A^f^t^-^{x). Observe that if the state x is such that <iE>(a;) > k then 
the left hand side is at most zero. If x is such that < $(a;) < fc, then we have A^(j~-^(x) < A<I>(a;) and can 
use upper bound (|33]) on A<I>(a;). Also, for all large enough r, <^{x) < implies A$(fc)(a;) = A^{x) and we 
can use lower bound pS)) on A^{x). 
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Therefore, we can write 



Aexp{e^1k){x)) < ~2d^{x)I{^x) < k}exp{e^^{x))mm{Z{x),a} 

- 2cie^x)^+{x)I{0 < ^{x) < fc}exp(6'$2(a;)) 
+ 2c2e^{x)I{0 < $(a;) < k} exp(6'l>2(a;)) ^ Z' 

i 

+ 2c3e^{x)I{0 < $(a;) < k} cxp{9^^{x)) 

- 2c250^ix)I{^{x) < 0} cxp{e^^{x)) J2 

i 

+ C7ei{^{x) < k}cxp{ei>-{x))exp{e^^{x)) 

+ cse^i{^x) < k}^^{x)cxp{e4>-{x))cxp{e^^{x)), 



where we switched from $(fc)(a;) to <jE>(a;) since they are equal when $ < k. We take the expectation of both 
sides with respect to the stationary distribution of the process. Since the expectation of the LHS is zero, 
and we can get rid of positive factor 6, we obtain 



$/{$ < k} exp(6'$2) min{Z, a} 



+ 2ciE 
< 2c2E 
+ 2C3E 
+ 2C25E 

+ C7dE 

+ CS0E 



<I>$+/{0 < $ < fc} exp(6i$2) 
$+/{0 < $ < fc} exp(6l(<l+)2) Z~ 
$+/{0 < $ < k}cxp{e{^+f) 

< 0} exp(6'($+)2) ^ Z: 

i 

/{$ < fc}exp(6i$~)exp(6'l>2)j 
/{$ < fc}$2exp(6'l>-)exp(6l$2) 



(46) 



where in the first two terms after <, we replaced $ by $+ because they are equal when $ > 0; similarly, in 
the third term after <, we replaced — $ and $^ by $^ and ($^)^, respectively, using condition $ < 0. 

Let us analyze term by term and obtain some bounds that are uniform in r and k. First consider 



2E 



< A:}exp(6'$^)min{Z,a} 



When <1> and Z have the same sign, the term is non-negative and we can drop it from the inequality. When 
l> < and Z > we have 

|2$/{4 < k}expie^^)mm{Z,a}\ < 2a^- expi0^^) < 2aMmax(5I exp(0M™L(I] 4^)')- 



For sufficiently small 9 > 0, applying Lemma [TOl we have 



lim sup 21 



/{$ < 0, Z >0} < k} exp(6l$2) niin{Z, a} 



< Cg, 



for some < cg < 00 (independent of k). Finally, when $ > 0, Z < we have 

2|$/{$ < A:}exp(6i$2)min{Z,a}| < 2$+/{$ < fc} cxp(6l($+)2) ^ Z". 
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Observe that we already have the expectation of such a term on the right hand side of our inequality (|46l) . 
up to a constant factor. 



For the second term in the inequahty ((46]), we have 



2ciE 



l>l>+/{l> < fc}exp(6i$2) 



2ciE 



$+)^/{$ < A:}exp(6'($+)^) 



(47) 



where g = g(r, fc, 9) is simply a notation for the RHS, for the ease of reference. 



We leave the first term after inequality (|46|) untouched for now. The second term after inequality ()46p is 
upper bounded by (7/4 + cio for some constant cio > 0, by considering the cases $ < c and $ > c separately, 
for a sufficiently large fixed c > 0. For the third term after inequality pS)) . we use the fact that for some fixed 
C26 > 0, condition $ < implies Zf < C26 ^^'^ therefore, by Lemma llOi this term is uniformly 

bounded for all r and all sufficiently small 6 > 0. 



Next consider 



C7II 



/{$ < A:}cxp(6i$')exp(6'l>2) 



The expectation on the event {$ < 0} is bounded by cjE,[cxp{d<t )exp(6'($ )^))] which, by Lemma [TUl is 
bounded by some cn > and sufficiently small 9 > 0, uniformly in r. The expectation on the event {$ > 0} 

is bounded by C7E /{$ < fc} exp(0(<I'+)^) which is upper bounded by 5/4 + 012 for some constant C12 > 0, 
again by considering the cases $ < c and $ > c separately, for a sufficiently large fixed c > 0. 

Finally, for the last term in (|46p 

C89E /{$ < fc}<|2exp(6'$-)exp(6i$2) , 

the expectation on the event {$ < 0} is uniformly bounded by some 0136*, for sufficiently small > 0, by 
applying Lemma [TOl The expectation on the event {$ > 0} is bounded by 

/{$+ < fc}($+)2cxp(e'($+)2) 

For sufficiently small > 0, to ensure cg9 < (l/2)ci, this term is upper bounded by g/A. Thus we can 
rewrite (l46l) as 



C21E 



($+)^/{$ < fc}exp(6'($+)'^) 



< C22E 



$+/{$ < k} exp(6i($+)2) J2 



+ Ci4, 



(48) 



for some positive 021,022,214. We analyze the term on the right-hand side. Fix C > 0. Then 
$+/{$ < fc}exp(6'($+)2)^4- = <l+/{C^Z.f < $ < fc}cxp(6i($+)2)^Z- 

+ $+/{$ < min(fc, Zr)} exp(6l$2) ^ 4" 

< (l/C)($+)2/{$ < fc}exp(6i($+)2) 
+ C(^Zr)2cxp(0C2(^Z-)') 



The second summand is bounded in expectation (by Lemma llOp for sufficiently small > 0. Consider 
constant C such that C21 — C22/C ~ C2i/2 (that is C = 2C22/C21 ). By the choice of C, if we apply the above 
estimates to the RHS of (|48p . we obtain 



(C2i/2)E ($+)"/{$< fc}exp(0($+)") <C24 
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for some C24 > 0. We have identified a constant C15 such that for every k 



Hm sup E 



($+)2/{$ < /c}cxp(6'($ 



< Ci5 < 00. 



Since, again by Lemma [TUl for sufficiently smaU ^ > 0, we also have for some Cig 



limsupE < k}exp{0{^-f) 

r— f 00 

we obtain for cq = C15 + cie 



< C16 < 00, 



lim sup E 



< fc}exp(6'(4)2) 



< Co < 00. 



This implies (|4ip and the proof of Proposition [T^ is complete. □ 

We now complete the proof of Theorem HJ^ii) . To show ([7]) , we use the same argument as the one for 
CoroUaryO with (Z+(c>d))^ and (Z'''+(c>d))^ replacing |Z(oo)| and |Z''(c>d)|, respectively. 
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